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Abstract 

Tight frames can be characterized as those frames which possess optimal numerical 
stability properties. In this paper, we consider the question of modifying a general 
frame to generate a tight frame by rescaling its frame vectors; a process which can 
also be regarded as perfect preconditioning of a frame by a diagonal operator. A 
frame is called scalable, if such a diagonal operator exists. We derive various char- 
acterizations of scalable frames, thereby including the infinite-dimensional situation. 
Finally, we provide a geometric interpretation of scalability in terms of conical sur- 
faces. 



1 Introduction 

Frames have established themselves by now as a standard notion in applied math- 
ematics, computer science, and engineering, see @|7]|. In contrast to orthonormal 
bases, typically frames form redundant systems, thereby allowing non-unique, but 
stable decompositions and expansions. The wide range of applications of frames 
can be divided into two categories. One type of applications utilize frames for de- 
composing data. Here typical goals are erasure-resilient transmission, data analysis 
or processing, and compression - the advantage of frames being their robustness as 
well as their flexibility in design. A second type of applications requires frames for 
expanding data. This approach is extensively used in sparsity methodologies such 
as Compressed Sensing (see ifTTI '). but also, for instance, as systems generating trial 
spaces for PDF solvers. Again, it relies on non-uniqueness of the expansion which 
promotes sparse expansions and on the flexibility in design. 

All such applications require the associated algorithms to be numerically stable, 
which the subclass of tight frames satisfies optimally. Thus, a prominent question 
raised in several publications so far is the following: When can a given frame be 
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modified to become a tight frame? The simplest operation to imagine is to rescale 
each frame vector. Therefore this question is typically phrased in the following more 
precise form: When can the vectors of a given frame be rescaled to obtain a tight 
frame? This is the problem we shall address in this paper. 

1.1 Tight Frames 

Let us first state the precise definition of a frame and, in particular, of tight and 
Parseval frames to stand on solid ground for the subsequent discussion. Letting 
be a real or complex separable Hilbert space and letting 7 be a subset of N, a set of 
vectors <I> = {<j(>;};e7 C M' is called a. frame for J^, if there exist positive constants 
A,B >0 (the lower and upper frame bound) such that 

A||xf < ^|(x,(py)p < B||xf forallxGJf. (1.1) 

A frame is called A-tight or just tight, if A = B is possible in and Parseval, 
if A = B = 1 is possible. Moreover, if |7| < oo (which implies that = with 
K = M or K = C), the frame O is cabled finite. 

To justify the claim of numerical superiority of tight frames, let <I> = C 
Jif be a frame for M' and let : — )• f'{J) with T^x := ((x, (Pj)) j^j denote the 

associated analysis operator. Its adjoint T^, the synthesis operator of <I>, maps £^{J) 
surjectively onto Jf. From the properties of T^, it follows that the frame operator 
S(S> :=T^T(p of given by 

S^x = ^ (x, (pj) (pj, X G J^f, 

is a bounded and strictly positive selfadjoint operator in J^. These properties imply 
that <I> admits the reconstruction formula 

x = J^{x,q)j)S:^^q)j forallxGJf". 
jeJ 

Inversion requires particular numerical attention, which implies that 5$ = const ■ 
l,yf is desirable (/^ denoting the identity on for .M' = we will use If^). And in 
fact, tight frames can be characterized as precisely those frames satisfying this con- 
dition. Thus an A-tight frame admits the numerically optimally stable reconstruction 
given by 

X = A"' • 2^ (x, (pj) (py for all x G . 
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1.2 Generating Parse val Frames 



This observation raises tlie question on how to carefully modify a given frame - 
which might be suitable for a particular application - in order to generate a tight 
frame. It is immediate that this question is equivalent to generating a Parseval frame 
provided we allow multiplication of each frame vector by the same value. Thus 
typically one seeks to generate Parseval frames. 

-1/2 

A very common approach is to apply ^.j, to each frame vector of a frame <I>, 
which can be easily shown to yield a Parseval frame. This approach is though of more 
theoretical interest due to the repetition of the problem to invert the frame operator. 
Hence, this construction is often not reasonable in practice. 

The simplest imaginable variation of a frame is just scaling its frame vectors. We 
thus coin a frame scalable, if such a scaling leads to a Parseval frame. It should also 
be pointed out that the scaling of frames is related to the notion of signed frames, 
weighted frames as well as controlled frames (see, e.g., lfT5l in[T6l). 

It is evident that not every frame is scalable. For example, a basis in which 
is not an orthogonal basis is not scalable, since a frame with two elements in ]R2 is 
a Parseval frame if and only if it is an orthonormal basis. As a first classification, 

shows that a frame <I> in with 
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the finite-dimensional version of Proposition 
analysis operator 7$ (the rows of which are the frame vectors) is scalable if and only 
if there exists a diagonal matrix D such that DJcj) is isometric. Since the condition 
number of such a matrix equals one, the scaling question is a particular instance of 
the problem of preconditioning of matrices. 



1.3 An Excursion to Numerical Linear Algebra 

In the numerical linear algebra community, the problem of preconditioning is well- 
known and extensively studied, see, e.g., IlllTSl. The problem to design precondition- 
ers involving scaling appears in various forms in the numerical linear algebra litera- 
ture. The common approach to this problem is to minimize the condition number of 
the matrix multiplied by a preconditioning matrix - in our case of Dr^, where D runs 
through the set of diagonal matrices. As shown for instance in H|, this minimization 
problem can be reformulated as a convex problem. However, as also mentioned in |4], 
algorithms solving this convex problem perform slowly, and, even worse, there exist 
situations in which the infimum is not attained. As additional references, we wish to 
mention |[6l El [H [Ml [181 for preconditioning by multiplying diagonal matrices from 
the left and/or the right, fl3 [IHl [El for block diagonal scaUng and |[l7l|5l [23 for 
scaling in order to obtain equal-norm rows or columns. 



3 



1.4 Our Contribution 



Our contribution to the scaling problem of frames is three-fold. First, these are the 
leadoff results on this problem. Second, with Theorem |2.7| we provide various char- 
acterizations of (strict) scalability of a frame for a general separable Hilbert space. 
In this respect, a particular interesting characterization derived in Theorem|2.7|states 



that a frame in a Hilbert space M' is strictly scalable if and only if there exists 
a frame *F in a presumably different Hilbert space ^ such that the coupling of the 
frame vectors of <I> and *F in ^ Ji^ constitutes an orthogonal basis. And, third. 
Theorems 3.2 and 3.6 provide a geometric characterization of scalability of finite 
frames. More precisely, we prove that a finite frame in ^ is not scalable if and only 
if all its frame vectors are contained in certain cones. 



1.5 Outline 



This paper is organized as follows. In Section |2] we focus on the situation of general 
separable Hilbert spaces. We first analyze when a scaling preserves the frame prop- 



erty (Subsection 2. 1 1, followed by a general equivalent condition in terms of diagonal 



operators (Subsection |2.2| ). Subsection |2.3| is devoted to the main characterization of 
strict scalability of frames. In Section [3] we then restrict to the situation of finite 



frames. First, in Subsection 3. 1 we derive a yet different characterization tailored 
specifically to the finite-dimensional case. Finally, this result is shown to give rise to 



a geometric interpretation of scalable frames in terms of quadrics (Subsection 3.2 1. 



2 Strict Scalability of General Frames 

In this section, we derive our first main theorem which provides a characterization of 
(strictly) scalable frames. We wish to mention that this result does not only hold for 
finite frames, but in the general separable Hilbert space setting. 



2.1 Scalability and Frame Properties 

We start by making the notion of scalability mathematically precise. We further intro- 
duce the notions of positive and strict scalability. Positive scalability ensures that no 
frame vectors are suppressed by the preconditioning. The same is true for strict scal- 
ability, which in addition prevents numerical instabilities caused by arbitrarily small 
entries in the matrix representation of the diagonal operator serving as preconditioned 

Definition 2.1. A frame = {<P;}ye7 for ^ is called scalable if there exist scalars 
Cj > 0, j G 7, such that {cj(py}yg/ is a Parseval frame. If, in addition, Cj > for all 
j G J, then is called positively scalable. If there exists 5 > 0, such that cj > 5 for 
all j G J, then is called strictly scalable. 
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Clearly, positive and strict scalability coincide for finite frames. Moreover, each 
scaling {cj(pj}j^j of a finite frame {(Pj}jej with positive scalars cj is again a frame. 
In the infinite-dimensional situation this might not be the case. However, if there 
exist K\,K2 > such that K\ < cj < Ki holds for all j € J, then also {cj(pj}j:^j is a 
frame, see O] Lemma 4.3]. A characterization of when a scaling preserves the frame 
property can be found in Proposition |2.2| below. This requires particular attention 
to the diagonal operator in f'{J) corresponding to a sequence c = {cj)jej C K, 
which is defined by 

Dc{vj)jeJ ■= {cjVj)j^j , {vj)jeJ e domD,, 

where 

domD, := {{vj)jej € e\j) : (cyvy)ye/ G 

It is well-known that Dc is a (possibly unbounded) selfadjoint operator in l'^ (J) if and 
only if Cj G M for all j G J. If even cj > (cj > 0, cj > d > 0) for each j G J, then 
the selfadjoint operator is non-negative (positive, strictly positive, respectively). 

Before we present the announced characterization, we require some notation. As 
usual, we denote the domain, the kernel and the range of a linear operator T by dom T, 
kerT and ranT, respectively. Also, a closed linear operator T between two Hilbert 
spaces and ^ will be called ICR (or an ICR-operator), if it is injective and has a 
closed range, i.e., if there exists 5 > such that ||r;c|| > 5\\x\\ for all;c G domT. We 
mention that the analysis operator of a frame is always an ICR-operator. 

The following result now provides a characterization of when a scaling preserves 
the frame property. 

Proposition 2.2. Let <I> = {^j}jej be a frame for ^ with analysis operator T<p and 
let c = {cj)j^j be a sequence of non-negative scalars. Then the following conditions 
are equivalent. 

(i) The scaled sequence of vectors *P := {cj(pj}j^j is a frame for J^. 

(ii) We have ran r<j, C domD^. and Dc \ ran 7$ is ICR. 
Moreover, in this case, the frame operator of the frame *F is given by 

S^. = (DcT^yiDcT^s.) = Tp^D^ro, 
where T^D^ denotes the closure of the operator T^D^. 

Proof. (i)=^(ii). Assume that *F is a frame and denote its analysis operator by T^i. 
Then, for x G M', the j'-th component of T^ix is given by 

{T^,x)j = {x,Cj(pj) = Cj{x,(pj) = {DcT^x)j. 
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Hence, T^i = DcT^. As domTqi = J^, this implies ranTcj, C domDc- Since is a 
frame, mnT^ is a closed subspace. And since *F is a frame, there exist A', B' > such 
that A'||;c|p < ||Dcr<i,;c||2 < B'||.x|P for all x G J^. In particular, for v = T^x G ranT^ 
we have 

\\Dcv\\l = llD^roxll^ > A'llxf > A'||r<i.||"2||^||2^ 

which shows that Dc\ ran 7$ is an ICR-operator. 

(ii)^(i). Conversely, assume that ranT.^, C domD^ and that Dc\ ranT^ is ICR. By 
the closed graph theorem and mnT^ C domD^., the operator DdranT^ is bounded, 
which implies the existence of A' , B' > such that 

A'||v||2 < ll^cvlll <B'||v||2 

holds for all v e raxiT^. Setting v = T^x and noting that r$ is bounded and ICR, we 
obtain constants A" ,B" > such that 

A"||xf < \\DcT<s.x\\l<B"\\xf 

holds for all x G J^. Consequently, *P is a frame. 

It remains to prove the moreover-pait, i.e., that [DcT^]* = T^Dc- Since DcT,^ 
is bounded, so is its adjoint {DcT^)* . In addition, it is easy to see that T^DcV = 
{DcT^)*v holds for all v in the dense subspace domD^. Hence, T^Dc is bounded and 
densely defined. Its bounded closure thus coincides with {Dc-T^)*. □ 



It is evident that the operator in Proposition is in general unbounded. The 
following corollary provides a condition on the frame which leads to necessarily 



bounded diagonal operators in Proposition 2.2 We remark that liminfyg/ shall be 
interpreted as liminf y^oo, which is a proper definition, since / C N was assumed. 
As it is custom, we set liminfygj to oo if y is finite. 



Corollary 2.3. Let<t>, ^ and c be as in Proposition 2.2 and assume liminfj,=j\\(pj\\ > 
0. Then *F is a frame if and only ifDc is bounded and Dc\^anT(^ is ICR. In this case, 
we have 

S^. = {DcT<s.)*{DcT<i.) = T^D^Jcp. 

Proof. If Dc has the above-mentioned properties, then *F is a frame by Proposition 
|2.2[ If *P is a frame, then there exists B >0 such that for each x E Jif we have 



'£c^j\{x,cpj)\^ < B\\x\ 
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In particular, for k £ J, c^||<p,t||^ < Since there exist 5 > and 70 G / such 

that ||<py|| > 5 for all j £ J, j > jo, this implies ct < B^l^5^^ for alXk £ J,k> Jq. 
Thus Dc is bounded as \\Dc\\ = supj^jCk- □ 
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2.2 General Equivalent Condition 

We now state a seemingly obvious equivalent condition to scalability, which is how- 
ever not straightforward to state and prove in the general setting of an arbitrary sepa- 
rable Hilbert space. 

Proposition 2.4. Let <I> = {(Pj}jeJ be a frame for J^. Then the following conditions 
are equivalent. 

(i) is (positively, strictly) scalable. 

(ii) There exists a non-negative {positive, strictly positive, respectively) diagonal 
operator D in (7) such that 



T*DDT^=I^. (2.1) 

Proof. (i)=^(ii). If <I> is scalable with a sequence of non-negative scalars {cj)j^j, then 
*y := {cj(pj}j^j is a Parseval frame. In particular, *F is a frame, which, by Proposition 
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implies that mnT^ C domD^ and that S^i = T^D^DcT^ is the frame operator of 
*P. Since the frame operator of a Parseval frame coincides with the identity operator, 
it follows that T^DcDcT.p = l^- 

(ii)=^(i). Conversely, assume that there exists a non-negative diagonal operator 
D in ^{J) such that T^DDT^ = 1,%'. Then DT<^ is everywhere defined. In particular, 
this implies that rwT^ C domD. Since T^ is bounded and D is closed, the operator 
DT,^ is closed. Hence, by the closed graph theorem, DT<^ is a bounded operator from 
.j^ into f'{J). In fact, (DT^)* (DT^) = Ij^ implies that DT^ is even isometric. Thus, 
from the boundedness of T^ we conclude that D\ ranT^ is ICR. Let c = {cj)jej be the 
sequence of non-negative scalars such that D = Dc. As a consequence of Proposition 
*F := {cj(pj}jej is a frame with frame operator S^> = l^', which implies that *P 
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is a Parseval frame. 

The proofs for positive and strict scalability of follow analogous lines. □ 
Under certain assumptions, the relation ( |2.1[ ) can be simplified as stated in the 



following remark which directly follows from Corollary 2.3 



Remark 2.5. If 5 := liminf^g/ > 0, then a diagonal operator D as in Proposition 



2.4 is necessarily bounded, and (2.1 1 reads 



TlD^T^=l^. 

Before stating our main theorem in this section, we first provide a highly useful 



implication of Proposition 2.4 showing that scalability is invariant under unitary 
transformations. 
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Corollary 2,6. Let U be a unitary operator in J^. Then a frame O = {cpj} j^j for 
is scalable if and only if the frame = {U (Pj}jeJ scalable. 

Proof Let O be a scalable frame for J^f with diagonal operator D. Since the analysis 
operator of Z/O is given by Tu^ = T^U*, 

T*^DTu^ = U^DDT^U* = UT^DDT^U* = UU* = Ij^, 

which implies scalability of U <I>. 

The converse direction can be proved similarly. □ 

2.3 Main Result 

To state the main result of this section, we require the notion of an orthogonal basis, 

which we recall for the convenience of the reader. A sequence {vytjyt of non-zero 
vectors in a Hilbert space is called an orthogonal basis of if inf^ \\vk\\ > and 
(v/t/||vyt||)yt is an orthonormal basis of J^. 

The following result provides several equivalent conditions for a frame «I> to be 
strictly scalable. We are already familiar with condition (ii). Condition (iii) can be 
interpreted as a 'diagonalization' of the Grammian of <I>, and condition (iv) shows 
that O can be orthogonally expanded to an orthogonal basis. 

Theorem 2.7. Let <I> = {(Pj}jeJ be a frame for Jif such that liminf^g/ \\(pj\\ > 0, and 
let T = T<^ denote its analysis operator Then the following statements are equivalent. 

(i) The frame <I> is strictly scalable. 

(ii) There exists a strictly positive bounded diagonal operator D in t^{J) such that 
DT is isometric {that is, T*D^T = Ijf). 

(iii) There exist a Hilbert space ^ and a bounded ICR operator L : J(f — >■ ^^{J) 
such that TT* +LL* is a strictly positive bounded diagonal operator. 

(iv) There exist a Hilbert space J(f and a frame ^ = {\\fj} j^j for such that the 
vectors 

form an orthogonal basis of M' ® . 

If one of the above conditions holds, then the frame from (iv) is strictly scalable, its 
analysis operator is given by an operator Lfrom (iii), and with a diagonal operator 
Dfrom (ii) we have 

L*D^L = Ijfr, and L*D^T = 0. (2.2) 
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Proof. (i)<J4>(ii). This equivalence follows from Proposition |2.4| (see also Remark 



23]). 

(ii)44>(iii). For the proof of (ii)=^(iii) let D be a strictly positive bounded diagonal 
operator in (^{J) such that T*D^T = I^. For the Hilbert space in (iii) we choose 

:= (ranDr)-L = ker r*D C f-{J). On JT we define the operator L : JT ^ f{J) 
by L := D^'|J^, which clearly is a bounded ICR operator. Then L* = PjfD^, 
where denotes the orthogonal projection in l'^{J) onto J(f . Let us show that 
DTT*D + Pjf coincides with the identity operator on 1^{J). Then 

TT* +LL* =D^DTT*DD^ ^D^PjfD^ 
= D \DTT*D + Pjfr)D^ 
= D\ 

which is a strictly positive bounded diagonal operator in i^{J), and (iii) is proved. 
Since DT is isometric, we have 

{DTT*Df = DT{DT)*{DT)T*D = DTT*D, 

which shows that DTT*D is a projection. Moreover, DTT*D is selfadjoint and thus 
an orthogonal projection. Since its kernel coincides with kerr*D = Jt^, it is the 
orthogonal projection onto Jt^^. This shows that DTT*D + Px = 

To prove the converse implication, suppose that (iii) holds with a Hilbert space 
and a bounded ICR operator L : JT ^ 1{J), such that TT* +LL* = with a 
strictly positive bounded diagonal operator D. Note that also D ' is strictly positive 
and bounded. Define the operator 

G:J^eJ(r^f{J), g(^^ ■=Tx + Ly, (^^ eJ^eJ^. (2.3) 

Then G*v = {T*v,L*vY , v G f{J), and hence GG* = TT* +LL*=D^. In particular, 
G is an isomorphism between JifQ)J^ and i^{J). Moreover, we have 

G*D^G = G*D^D^G * = 1,^^^. 

This implies that 

\ _ (T*\ . n2n - ('^*^^'^ ^*^^^ 
Ije) ~ \L* J^^ [l*D^T L*D^L 

or, equivalently, 

T*D^T = I^, L*D^L = Ix, and L*D^T = 0, 



which, in particular, yields (ii) (and (2.2 1). 
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(iii)44>(iv). For the implication (iii)=^(iv), let D, L and G be as above and define 
:= L*ej, j G /, where ej denotes the j-th vector of the standard orthonormal basis 
{ej}iej of t^{J)- As L is a bounded ICR operator and 

I K^, V^)>P = I K^,^*^i>P = 'L\{Lx,ej)\^ = \\Lxf 
jeJ jeJ jeJ 

for all X e J^, it follows that *P = {Yj}jeJ is a frame. Note that T*ej = (pj, j G J. 
Hence, (pj © xjfj = T*ej®L*ej = G*ej, j G J, and therefore 

{(Pj®Yj,(pk®¥k) = {G*ej,G*e!,) = {GG*ej,ek) = {D-^ej^eu) = cfSjk. 

As the c/s are bounded and G* is an isomorphism, this shows that the sequence 
{(Pj © Wj}je J is an orthogonal basis of £^{J). 

Finally, to prove the converse implication, suppose that (iv) holds true and denote 
by L the analysis operator of the frame Since {cpj © Yj}jeJ is an orthogonal 
basis of Jif (B ^ , for all j^k G J we have (<P;, (pu) + iVjiVk) = djdjk, where dj = 
\\(pj\\^ + II V'y'lP' j £ Note that the sequence {dj)jej is bounded and bounded from 
below by a positive constant. Hence, for all j,k G J, 

{{TT* +LL*)ej,eu) = {T*ej,T*ek) + {L*ej,L*ek) = {(Pj,(pk) + {Yj,¥k) 
= djdjk = {djej,ek). 

This implies TT* +LL* = D^, where d := {dj)jej- The operator Dd is a strictly 
positive bounded diagonal operator, which proves (iii). □ 



The restriction of conditions (iii) and (iv) in Theorem |2.7| to the situation of finite 
frames is not immediate and requires some thought. This is the focus of the next 
result. 

Corollary 2.8. Let O = {<Py}^i be a frame for and let T = T^£ IC'*^^^ denote 
the matrix representation of its analysis operator. Then the following statements are 
equivalent. 

(i) The frame <I> is strictly scalable. 

(ii) There exists a positive definite diagonal matrix D G j^^^''^ such that DT is 
isometric. 

(iii) There exists L G "^'^'^i^^^) such that TT* +LL* is a positive definite diagonal 
matrix. 

(iv) There exists a frame ^ = {Wj]f=i for K^"^ such that {(pj © G 
forms an orthogonal basis ofMJ^. 
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Proof. We prove this result by using the equivalent conditions from Theorem |2.7 



First of all, we observe that M' = K'^ and f'{J) = K^. Moreover, condition (ii) 



obviously coincides with Theorem 2.7 ii), so that (i)<^(ii) holds. The equivalence 
(iii)44>(iv) can be shown in a similar way as the equivalence (iii)<^^(iv) in Theorem 



are 

xM 



Hence, it remains to show that (iii) and the condition (iii) in Theorem |2.7 
equivalent. For this, assume that (iii) holds, set := IC'*^^'^ and G := [r|L] G "K!^ 
Then, since GG* = TT* +LL* is a positive definite diagonal matrix, it follows that 
G is non-singular and therefore kerL = {0}. Thus, L is ICR, and (iii) in Theorem 
holds. For the converse, recall that the operator G : ® ^ — in (|2.3|) was 



2.7 



shown to be an isomorphism in the proof of Theorem 2.7 Hence, dimJ^ = M — N. 
Thus, with soine (bijective) isometry V : IK^"^ ^ and Z : = G ^MxIm-n) 
have TT* +LL* = TT* +LL*. □ 



Finally, we apply Theorem 2.7 to the special case of finite frames with N +1 
frame vectors in K^, which leads to a quite easily checkable condition for scalability. 
For this, we again require some prerequisites. Letting = {<p,}yli be a frame for 
the Hilbert space K^, by we denote the set of indices k ^ {1, • • • ,M} for which 
((p^, (pj) = holds for all 7 G { 1 , . . . ,M} \ {k}. Note that = { 1 , . . . ,M} holds if 
and only if <I> is an orthogonal basis of K^. In particular, this implies M = N. 

Corollary 2.9. Let <t> = {(Pj}^^i be a frame for such that (pj / for all j = 
1, . . . ,A'^+ 1. Then 7^ {1, . . . ,A'^+ 1}, and the following statements are equivalent. 

(i) <I> is strictly scalable. 

(ii) There exist ^ G {1, . . . ,A'^+ 1} \ 1^0 and c > such that 

{(pi,(pk){(pk,(Pj) = -c{(pi,(pj) 
holds for all i,j G {1, . . . ,A'^+ 1} \ {/:}, j- 

(iii) For all k £ {I , . . . ,N + 1} \ there exists Ck> such that 

{(pi,(pk){(pk,(pj) = -Ck{(pi,(pj) 

holds for all i,j G {1, . . . ,A^+ 1} \ {A:}, j- 

Proof. As remarked before, ^<j) = {l,...,N + 1} implies that <I> is an orthogonal 
basis of K'^, which is impossible. 



(i)^(iii). For this, let ^ G {1, . . . ,A^ + 1} \ ^<i. be arbitrary. By Theorem 2.7 (see 



also Corollary 2.8 1 there exists v = (vi , . . . , v^+iY G 1C''+^ such that T^T^ + vv* is a 
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diagonal matrix. Hence, {(pi, (pj) + v,Vy = holds for all G {1, . . . ,A'^+ 1}, / / j. 
Therefore, for /, j G {1, . . . ,A'^+ 1} \ {k}, i / j, we have 

{(Pi,(Pk){(pk,(pj) =ViV]\Vk\^ = -\vk\^{(pi,(pj). 

If vk = 0, then {q)k, (pj) = for all j G {1, . . . + 1} \ {k}. But since k ^ 0^ was 
assumed, it follows that jv^-p > 0, and (iii) holds. 
(iii)=^(ii). This is obvious. 

(ii)=^(i). Assume now that (ii) is satisfied, and set 

Vk:=Vc and vj := -v]^\(pj,(pk) (7 G {1, . . . ,A^ + 1} \ W). 
Then v,v^ = -((?);, 9^) for / G {1, . . . ,A^+ 1} \ {^} and 

ViV]=\vkl^{(Pu(Pk){(Pk,(Pj) = -{(pi,(pj) 

for /,7 G {1, . . . ,A'^+ 1} \ {k}, i 7^ j. This implies that T^T^ + vv* is a diagonal matrix 
whose diagonal entries are positive (since otherwise = ||9y|p + |vyp and thus (pj = 



for some 7 G {1, . . . ,A'^ + 1}). Now, (i) follows from Theorem 2.7 □ 



As mentioned above. Corollary 2.9 might be utilized to test whether a frame 
for IC^ with N +1 frame vectors is strictly scalable or not. Such a test would con- 
sist of finding an index k ^ tffip and checking whether there exists a c > such that 
{(Pi,(pk){(pk,(Pj) = -c{(pi,(pj) holds for all/,; G {1, . . . ,A^+ 1} \ {^c}, / / 

3 Scalability of Real Finite Frames 

We next aim for a more geometric characterization of scalability. For this, we now 
focus on frames for M^. The reason why we restrict ourselves to real frames is that 
in the proof of the main theorem in this section we make use of the following variant 
of Farkas' Lemma which only exists for real vector spaces. 

Lemma 3.1. Let A : V ^ W be a linear mapping between finite-dimensional real 
Hilbert spaces {V, {■ , ■)v) and {W, {■ , ■)w)> l^t {^i}^=i orthonormal basis ofV 

and let b £W. Then exactly one of the following statements holds: 

(i) There exists xGV such that Ax = b and {x,ei)v > 0/or all i = 1, . . . ,A^. 

(ii) There exists y £W such that {b,y)w < and {Aei,y)w ^ 0/or all i = 1, . . . ,N. 



Lemma 3.1 can be proved in complete analogy to the classical Farkas' Lemma, 
where V = W and W = W", ?i,m G N. A proof of this statement can, for instance, be 
found in |l3lThm5.1]. 
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3.1 Characterization Result 



The following theorem provides a characterization of non-scalability of a finite frame 
specifically tailored to the finite-dimensional case. In Subsection |3.2[ condition (iii) 
will then be utihzed to derive an illuminating geometric interpretation. 

Theorem 3.2. Let <I> = {(Pj}f^^ C \ {0} be a frame for R^. Then the following 
statements are equivalent. 

(i) <I> is not scalable. 

(ii) There exists a symmetric matrix Y G M^^^ with tr(y) < such that (pjYcpj > 
for all j = l,...,M. 

(iii) There exists a symmetric matrix Y G M^^^ with ti{Y) = such that (pjY(pj > 
for all 7 = 1,...,M. 

Proof. (i)<^^(ii). Let W denote the vector space of all symmetric matrices X £ M.^^'^, 
and let (• , ■)w denote the scalar product on W defined by {X,Y)w '■= tr(Xy), X,Y £ 
W. Furthermore, define the linear mapping A : — )• IV by 



Ax:=T^disig{x)T(i,, x £ \ 



By Proposition 2.4 the frame <t> is not scalable if and only if there exists no x £ 



x>0, with Ax = In. Hence, due to Lemma 3.1 <I> is not scalable if and only if there 
exists Y £W with tr(F) = {In,Y)w < such that 

< {Aej,Y)w = triiAe j)Y) = tr((p,(pjF) = (pjYcpj 

holds for all 7 = 1, . . . ,M, where {ej}^^^ denotes the standard basis of M.^. This 
proves the equivalence of (i) and (ii). 

(ii) =^>(iii). For this, let Yi £W with a := -tr(Fi) > such that (pjYi(pj > 
for all 7 = 1, . . . ,M, and set F := Fi + ^In- Then tr(F) = and q)jY(pj > for all 
7 = 1 , . . . ,M, as desired. 

(iii) =^>(i). Assume now, that there exists F G as in (iii), that is, {In,Y)]/v = 
and {Aej,Y)w > for all j. Suppose that is scalable. Then there exists x G U.^, 
x>0, such that Ax = 1^. This implies 

M 

= (/w,F)iv = {Ax,Y)w = ^xy(Ae^-,F)w., 

7=1 

which yields x = 0, contrary to the assumption Ax = In- The theorem is proved. □ 

This theorem can be used to derive a result on the topological structure of the set 
of non-scalable frames for M.^ . In fact, the corollary we will draw shows that this set 
is open in the following sense. 
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Corollary 3.3. Let <I> = {(py} jli C \ {0} be a frame for which is not scalable. 
Then there exists £ > such that each set of vectors {V'yiyli C with 

\Wj~Wi\\<^ forallj = l,...,M (3.1) 
is a frame for which is not scalable. 

Proof. Choosing a subset 7 of {1, . . . ,M} such that {(pj}j(^j is a basis of M^, it fol- 
lows from the continuity of the determinant that there exists £i > such that all sets 



3.2 



of vectors {Yj}f=i C M.^ with (3J_i (e replaced by ei) are frames. By Theorem 
there exists a symmetric matrix Y G M^^^ with tr(F) < such that (p[Y(pi > for al 
/. By adding 5In to Y with some 5 > we may assume without loss of generality that 
tr(F) < and (pjYcpj > for all j (note that the frame vectors of are assumed to 
be non-zero). Since the function x i— )• x^Yx is continuous, it follows that there exists 
£ G (0,£i) such that for each frame {Yj}f=[ C with ( |3T| ) we have Yj^Yj > 



for all j. By Theorem 3.2 the frame {Yj}f=i is not scalable, which finishes the 
proof. □ 

3.2 Geometric Interpretation 

We now aim to analyze the geometry of the vectors of a non-scalable frame. To derive 
a precise geometric characterization of non-scalability, we will in particular exploit 



Theorem 3.2 As a first step, notice that each of the sets 

C±{Y) := {;c G : ±x^Yx > 0}, Ye R^""^ symmetric. 



considered in Theorem |3.2| (iii) is in fact an open cone with the additional property 
that X G C±{Y) implies —x G C±{Y). Thus, in the sequel we need to focus our atten- 
tion on the impact of the condition tr(y) = on the shape of these cones. 

We start by introducing a particular class of conical surfaces, which due to their 
relation to quadrics - the exact relation being revealed below - are coined 'conical 
zero-trace quadrics'. 

Definition 3.4. Let the class of conical zero-trace quadrics ^ be defined as the 
family of sets 

G : £ ak{x,ek)^ = {x,eN)^'^ , (3.2) 

where {ek}^^i runs through all orthonormal bases of and {a^)^^^ runs through 
all tuples of elements in M \ {0} with Lf=/ a^ = \. 

The next example provides some intuition on the geometry of the elements in this 
class in dimension N = 2,3. 
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Example 3.5. 



N = 2. In this case, by setting e± := {\/V2){ei ±^2), a straightforward com- 
putation shows that ^2 is the family of sets 

{xeM^ : {x,e^){x,e+) =0}, 

where {e-,e+} runs thi^ough all orthonormal bases of M?. Thus, each set in 
'^2 is the boundary surface of a quadrant cone in M^, i.e., the union of two 
orthogonal one-dimensional subspaces in M^. 

A'^ = 3. In this case, it is not difficult to prove that ^2 is the family of sets 

{;t:GM^ : a{x,eif + {\ - a){x,e2f = {x,e3f}, 

where {ej}^^y runs through all orthonormal bases of and a runs through all 
elements in (0, 1). The sets in are the boundary surfaces of a particular class 
of elliptical cones in M^. 

To analyze the structure of these conical surfaces we let {ei,e2,es} be the 
standard unit basis and a £ (0, 1). Then the quadric 

{x gM^ ■.a{x,eif + {\-a){x,e2f = {x,e3f} 

intersects the planes {xt, = ±1} in 

|(xi,X2, ±1) : axj + (1 —a)x^ ~ ^} ■ 

These two sets are ellipses intersecting the corner points (ibl,ibl,ibl) of the 
unit cube. Thus, the considered quadrics are elliptical conical surfaces with 
their vertex in the origin, characterized by the fact that they intersect the corners 
of a rotated unit cube in M^, see also Figure 3.2 b) and (c). 



Note that ( |3.2[ ) is by rotation unitarily equivalent to the set 

( N-l "1 



X G : x^ - £ akxl = 0\. (3.3) 



k=i 



Such surfaces uniquely determine cones by considering their interior or exterior. Sim- 
ilarly, we call the sets 



jxGM^: Y,^at{x,ekf <{x,eNfj 

( N-l 

and < X G : £ ak{x,ek)^ > (x,g/v) 
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the interior and the exterior of the conical zero-trace quadric in p.2| ), respectively. 

Armed with this notion, we can now state the result on the geometric characteri- 
zation of non-scalability. 

Theorem 3.6. Let C M'^ \ {0} be a frame for M^. Then the following conditions 
are equivalent. 

(i) <I> is not scalable. 

(ii) All frame vectors of <I> are contained in the interior of a conical zero-trace 
quadric of^t^. 

(iii) All frame vectors of are contained in the exterior of a conical zero-trace 
quadric of^t^. 

Proof. We only prove (i)<;^(ii). The equivalence (i)<;^(iii) can be proved similarly. 



By Theorem 3.2 a frame O = {<Py}jLi C \ {0} for M'^ is not scalable if and only 
if there exists a real symmetric 'N x A^-matrix F with tr(y) = such that (pjYcpj > 
for all j = I, . . . ,M. Equivalently, there exist an orthogonal matrix U G MJ^^'^ and 
a diagonal matrix D G M^''^ with tr(D) = such that {U(pjYD{U(pj) > for all 
i = 1, . . . ,M. Note that, due to continuity reasons, the matrix D can be chosen non- 
singular, i.e., without zero-entries on the diagonal. Hence, (i) is equivalent to the 
existence of an orthonormal basis {ek}^^^ of M'^ and values d\, . . . ,dN \ {0} 
satisfying ^^^j dk = and 

N 

I 

k=l 



Y,dk{q)j,ekf >0 for all; = 1,...,M. 



By a permutation of {1,...,A'^} we can achieve that d^ > 0. Hence, by setting 
at '■= —dk/dp^ for ^ = 1, . . . — 1, we see that (i) holds if and only if there exist an 
orthonormal basis {ek}^^x of and a\,..., a^-i G M \ {0} such that <^k = ^ 
and 

£ ak{(Pj,ekf < {(Pj,eNf for all j = 1, . . . ,M. 

k=\ 

But this is equivalent to (ii). □ 

By 'lo^ we denote the subclass of ^ consisting of all zero-trace conical quadrics 
in which the orthonormal basis is the standard basis of R^. That is, the elements of 



are quadrics of the form ( |3.3| ) with non-zero fl'^:'s satisfying L^^/ '^k = 1- The next 



corollary is an immediate consequence of Theorem 3.6 and Corollary 2.6 



Corollary 3.7. Let <I> C \ {0} be a frame for M^. Then the following conditions 
are equivalent. 
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(i) <I> is not scalable. 



(ii) There exists an orthogonal matrix U G M^^'^ such that all vectors ofU't> are 
contained in the interior of a conical zero-trace quadric of^^. 

(iii) There exists an orthogonal matrix U G M^^^ such that all vectors ofU^ are 
contained in the exterior of a conical zero-trace quadric of^^. 



Utilizing Example |3 .51 we can draw the following conclusion from Theorem 3.6 
for the cases N = 2,3. 

Corollary 3.8. (i) A frame ^ CM?\ {0}for M? is not scalable if and only if there 
exists an open quadrant cone which contains all frame vectors of^. 

(ii) A frame <I> C \ {0} for is not scalable if and only if all frame vectors 
of^ are contained in the interior of an elliptical conical surface with vertex 
and intersecting the corners of a rotated unit cube. 



To illustrate the geometric characterization, Figure 3.2 shows sample regions of 
vectors of a non-scalable frame in and M?. 






(a) 



(b) 



(c) 



Figure 1: (a) shows a sample region of vectors of a non-scalable frame in M^. (b) and 
(c) show examples of sets in which determine sample regions in M^. 



4 Acknowledgements 

G. Kutyniok acknowledges support by the Einstein Foundation Berlin, by Deutsche 
Forschungsgemeinschaft (DFG) Grant SPP-1324 KU 1446/13 and DFG Grant KU 
1446/14, and by the DFG Research Center Matheon "Mathematics for key tech- 
nologies" in Berlin. F. Philipp is supported by the DFG Research Center MATH- 
EON. K. A. Okoudjou was supported by ONR grants N000140910324 and NOOOl- 
40910144, by a RASA from the Graduate School of UMCP and by the Alexander 
von Humboldt foundation. He would also like to express his gratitude to the Institute 
for Mathematics at the University of Osnabriick for its hospitality while part of this 
work was completed. 



17 



References 

[1] p. Balazs, J.-P. Antoine, and A. Grybos, Weighted and controlled frames: Mu- 
tual relationship and first numerical properties, Int. J. Wavelets Multiresolut. 
Inf. Process. 8 (1) (2010), 109-132. 

[2] V. Balakrishnan, and S. Boyd, Existence and uniqueness of optimal matrix scal- 
ings, SIAM J. Matrix Anal. Appl. 16 (1) (1995), 29-39. 

[3] L.D. Berkovitz, Convexity and optimization in M", John Wiley & Sons, Inc., 
New York, 2002. 

[4] R.D. Braatz and M. Morari, Minimizing the Euclidian condition number, SIAM 
J. Control Optim. 32 (6) (1994), 1763-1768. 

[5] A.M. Bradley, Algorithms for the equilibration of matrices and their applica- 
tion to limited-memory Quasi-Newton methods, PhD thesis, ICME, Stanford 
University, 2010. 

[6] S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear matrix inequal- 
ities in system and control theory, SIAM Studies in Applied Mathematics. 15. 
Philadelphia, PA: SLAM, Society for Industrial and AppHed Mathematics, xii, 
1994. 

[7] PG. Casazza and G. Kutyniok, Finite frames: Theory and applications, Birk- 
hauser Boston, Inc., Boston, MA, to appear. 

[8] K. Chen, Matrix preconditioning techniques and applications, Cambridge 
Monographs on Applied and Computational Mathematics 19. Cambridge: 
Cambridge University Press xxiii, 2005. 

[9] O. Christensen, An introduction to frames and Riesz bases, Birkhauser Boston, 
Inc., Boston, MA, 2003. 

[10] S.C. Eisenstat, J.W. Lewis, and M.H. Schultz, Optimal block diagonal scaling 
of block 2-cyclic matrices. Linear Algebra Appl. 44 (1982), 181-186. 

[11] Y.C. Eldar and G. Kutyniok, Compressed Sensing: Theory and appUcations, 
Cambridge University Press, Cambridge, UK, to appear. 

[12] L. Eisner, A note on optimal block-scaUng of matrices, Numer. Math. 44 (1984), 
127-128. 

[13] I. Farago and J. Karatson, Numerical solution of nonlinear elliptic problems via 
preconditioning operators. Nova Science PubUshers, Inc., New York, 2002. 



18 



[14] L.Yu. Kolotilina, Solution of the problem of optimal diagonal scaling for quasi- 
real Hermitian positive-definite 3x3 matrices, Zap. Nauchn. Semin. POMl 309 
(2004), 84-126, 191-192; translation in J. Math. Sci. 132 (2) (2006), 190-213. 

[15] 1. Peng and S. Waldron, Signed frames and Hadamard products of Gram matri- 
ces. Linear Algebra Appl. 347 (2002), 131-157. 

[16] A. Rahimi and P. Balazs, Multipliers for p-Bessel sequences in Banach spaces, 
Integral Equations Oper. Theory 68 (2) (2010), 193-205. 

[17] D. Ruiz, A scaling algorithm to equilibrate both rows and columns norms in 
matrices, Technical Report RT/APO/01/4, ENSEEIHT-IRIT, 2001. 

[18] A. Shapiro, Upper bounds for nearly optimal diagonal scaling of matrices, Lin- 
ear Multilinear Algebra 29 (2) (1991), 145-147. 

[19] A. Shapiro, Optimal block diagonal /^-scaling of matrices, SIAM J. Numer. 
Anal. 22(1985), 81-94. 

[20] A. van der Sluis, Condition numbers and equilibration of matrices, Numer. 
Math. 14 (1969), 14-23. 

Contact information 

Gitta Kutyniok: Technische Universitat Berlin, Institut fur Mathematik, StraBe des 
17. Juni 136, 10623 BerUn, Germany, kutyniok@math.tu-berlin.de 

Kasso A. Okoudjou, Department of Mathematics, University of Maryland, College 
Park, MD 20742 USA, kasso@matii.umd.edu 

Friedrich PhiUpp: Technische Universitat Berlin, Institut fiir Mathematik, StraBe des 
17. Juni 136, 10623 Berlin, Germany, philipp@math.tu-berlin.de 

Elizabeth K. Tuley, Department of Mathematics, University of CaUfomia at Los An- 
geles, Los Angeles, CA 90095 USA, ektuley@umd.edu 



19 



